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BACKGROUND OF THE INVENTION 
Field of the invention 

The present invention relates to transmission of 
5 force feedback over a long distance, in particular in the 
context of developing distributed virtual worlds and 
telepresence systems . 
Description of the prior art 

In the same way that digital video coding 
10 techniques are based on a knowledge of visual perception 
and voice recognition techniques are based on a knowledge 
of hearing, haptic techniques (from the Greek haptos ; 
hand) are based on a knowledge of gestures. 
^ There are two sorts of fine gesture that can be 

yy 15 executed by the hand: ballistic gestures, such as moving 
jj*? the hand toward a glass before taking hold of it, and 

Ifi gestures with touch feedback, such as moving the glass 

08 toward the mouth after taking hold of it and closing the 

7* clamp formed by the thumb and the fingers. The brain is 

jh& 20 then informed continuously of the force with which the 
ft hand is gripping the glass and of the weight of the 

£ glass, which depends on the quantity of liquid in it. The 

|W brain then reacts by giving the motor instruction to 

"grasp" the glass sufficiently tightly for it not to be 
25 dropped, but not too tightly, so as not to break it or 
expend energy uselessly. 

Ballistic gestures activate the motor reflex arc 
but they do not activate the touch feedback sensing 
reflex arc. Force feedback can be a visual representation 
30 of the space, but also a gestural map, that is to say a 
learned or innate mental representation hardwired into 
the brain and which automatically generates the sequence 
of motor instructions to the muscles of the shoulder, the 
arm and the hand to perform the ballistic gesture as a 
35 function of a particular mental representation of the 
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space, in particular of the assumed hand-glass distance. 

For ballistic gestures, it is sufficient to 
transmit information on the gesture to the brain with a 
sampling frequency of 100 Hz. This means that if a sample 
5 of the signal is sent every 10 ms, the signal transmitted 
will contain all the information pertinent to the 
ballistic gesture. 

Gestures with touch feedback simultaneously 
activate the motor reflex arc and the sensing reflex arc. 

10 The brain closes the loop and in humans the complete 
cycle takes less than 1 ms . The bandwidth of the sensing 
neurons in the ends of the fingers, i.e. the maximum 
mechanical signal frequency that the neurons can detect 
and transmit to the brain, is greater than 500 Hz. To be 

15 able to code a fine gesture in a computer, the force 
feedback system used must itself have a high operating 
frequency, in accordance with Shannon's theorem a 
frequency of at least twice the bandwidth of the fingers. 

In practice, force feedback systems on a local 

20 machine typically operate at a frequency of 1 kHz and in 
a local closed loop, meaning that feedback is calculated 
and then applied to their motors and then perceived by 
the hand every 1/1000 second. This avoids the effect 
known as the "electric toothbrush" effect: the instrument 

25 held in the hand must not give the impression of 
vibrating . 

The frequency of 1 kHz results from the following 
compromise: it must not be too low, if the tactile 
impression is to be reproduced finely, or too high, if 
30 the computer is to have sufficient time to calculate the 
feedback force that will represent the fine simulation of 
the gesture executed in the virtual mechanical world. 

If it is necessary to transmit via a 
telecommunication network fine gestures coded by the 
35 force feedback system and fine gestures with feedback, 
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the problem is more complicated because of the generally 
much greater latency introduced by the network itself. 

Using the ISDN technology, the latency is 30 ms, 
using the ADSL technology it is of the order of 200 ms, 
5 and on the Internet it can be as much as 6 s or even lead 
to the message being purely and simply rejected. The ADSL 
and Internet latency varies because of the asynchronous 
nature of the networks. The frequency of 1 kHz is 
therefore much too high to be maintained if the closed 

10 loop includes a return trip via the network - the gesture 
is coded and then transmitted via the network, applied to 
a remote object, and feedback from the object is in turn 
coded and sent back via the network. 

A ballistic gesture can be transmitted with a time- 

15 delay of the order of 10 ms . Sight is a monodirectional 
sense: the eye is a kind of camera recording a scene and, 
ignoring a tolerance value, the brain can perceive the 
precise visual film with a slight time-delay without 
disturbing the execution of the gesture. 

20 On the other hand, a fine gesture with feedback 

requires a loop of less than one millisecond for the 
return trip to make the decision on the intensity of the 
force to be applied: 

- sending of the instruction to the muscle via the 
25 motor sensing reflex arc, 

- mechanical action of the hand on the glass, 

- sensation at the ends of the fingers of touching 
the glass (increased contact pressure) , and 

- return of information to the brain via the 
30 tactile sensing reflex arc to enable the brain to decide 

to adjust the force applied to the "clamp". 

A method known as the "wave transform" method for 
transmitting this kind of fine gesture is nevertheless 
described by John Wilson and Neville Hogan of MIT in 
35 "Algorithms for Network-Based Force Feedback", Fourth 
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PHANTOM Users Group Workshop (PUG 99) . The method 
simulates the time-delay introduced by the network by 
means of an artificial viscosity that stabilizes the 
feedback loop: the greater the time-delay introduced by 
5 the network, the more viscous the system. 

The "wave transform" method transposes into the 
force/speed space the theory of passive quadripole 
networks with pure time-delay that is well known to the 
skilled person for electrical voltage/current parameters. 

10 The theory is used to calculate the incident and 
reflected electrical waves as a function of the 
characteristic impedance of the line. Transmission of the 
electrical signal is optimized if the line is terminated 
with the same characteristic impedance. 

15 Ohm's law U = Z X I is transposed into the 

mechanical space by the law F - Viscosity x Speed and the 
"wave transform" method consists of adapting a virtual 
pure time-delay line by assigning it a characteristic 
impedance (in reality a viscosity) , which is that of the 

20 remote-controlled robot. The signal is transmitted in the 
form of its Z transform, S(z) = E (s ( t ) Xe (2iX7CXnxT) ) in which T 
is the fixed time-delay of the network. The greater the 
time-delay introduced by the network, the greater the 
artificial viscosity that must be introduced into the 

25 line to stabilize the distributed mechanical simulation 
of the fine gesture in a closed loop in the network. 

The gestural sensation is undoubtedly distorted, 
but transmission of the useful signal is optimized. This 
method was published following the Fourth Users Group 

30 Workshop (PUG99) . 

The "wave transform" method requires a synchronous 
network, i.e. a network whose time-delay is fixed and 
known, for example an ISDN. It is based on the Z 
representation of sampled discrete signals whose period 

35 is equal to the known fixed time-delay of the network. 
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It is therefore inapplicable to message-based 
asynchronous Internet, ATM or UMTS type networks, which 
are characterized by a variable transmission time-delay 
and by a rejection if the message is lost or takes too 
5 long to cross the network. 

The problem of the excessively fast timing of force 
feedback systems is exacerbated in asynchronous networks, 
for which: 

- messages can be lost or rejected or fail to 
10 arrive if the acknowledgement is delayed for too long 

(TCP/IP) , 

- messages which reach the correct destination take 
a variable time to cross the network, 

- they do not necessarily arrive in the order in 
15 which they were sent, and 

- there is no common clock for the two machines 
accurate to within one millisecond. 

The invention proposes to remedy the drawbacks of 
the prior art systems. 

20 SUMMARY OF THE INVENTION 

The invention proposes a control system for a force 
feedback member able to interact with another member, of 
the type with a time constant less than that associated 
with remote control, which system includes a local model 

25 for calculating a set point addressed to the force 
feedback member from a variable measured by the force 
feedback member, variables intrinsic to the force 
feedback member, an estimate of an external interaction 
with the force feedback member, and a state variable of 

30 the force feedback member, a remote model for estimating 
interactions and state variables of the other member with 
updating on receipt of data from another remote system, 
and resynchronizer means able to send a resynchronization 
message to the other system. 

35 Thus the behavior of the remote element is 
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simulated locally. 

The system advantageously includes a phantom model 
for obtaining an estimate of state variables of the force 
feedback member and resynchronizing the estimate on 
5 reception of the resynchronization message. The phantom 
model is used to simulate locally the remote model of the 
remote control system. 

In one embodiment of the invention, the 
resynchronizer means include comparator means for 

10 comparing the estimate of state variables from the 
phantom model and state variables from the local model so 
that in the event of a difference exceeding a 
predetermined threshold the resynchronization means can 
send a resynchronization message to the phantom model and 

15 to the other system. 

In one embodiment of the invention, the system 
includes extrapolator means for processing a 
resynchronization message for updating the remote model 
received from the other system. 

20 The invention also proposes a system for 

controlling two force feedback members situated at a 
distance from each other. Each member is provided with a 
control system including a local model for calculating a 
set point addressed to the force feedback member from a 

25 variable measured by the force feedback member, variables 
intrinsic to the force feedback member, an estimate of an 
external interaction with the force feedback member, and 
a force feedback member status variable, a remote model 
for estimating interactions and state variables of the 

30 other member, with updating on reception of data received 
from another, remote system, and resynchronization means 
adapted to send a resynchronization message to the other 
system. 

The invention also proposes a method of controlling 
35 a force feedback member able to interact with another 


7 


member, the method including: 

- local modeling to obtain a set point sent to the 
force feedback member from a variable measured by the 
force feedback member, variables intrinsic to the force 
feedback member, an estimate of an external interaction 
with the force feedback member, and a state variable of 
the force feedback member; 

- remote modeling of the interactions and the state 
variables of the other member with updating on receiving 
data from another remote system; 

- generating a resynchronization message and 
sending it to said other system. 

The method advantageously includes phantom modeling 
of state variables of the force feedback member with 
resynchronization on receiving the resynchronization 
message. 

In one embodiment of the invention, at the time of 
resynchronization, the estimate of state variables from 
the phantom modeling and state variables from the local 
modeling are compared so that in the event of a 
difference exceeding a predetermined threshold a 
resynchronization message can be sent to the other system 
with a view to new phantom modeling. 

One embodiment of the invention includes 
extrapolation to process a resynchronization message from 
the other system and to update the remote modeling. 

The invention also provides a computer program 
including program code means for executing the steps of 
the method when said program runs on a computer. 

The invention also provides a medium capable of 
being read by a reader and storing program code means for 
executing the steps of the method when said program runs 
on a computer . 

The present invention applies with advantage to 
bidirectional systems, for example video games with 
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control handgrips provided with force feedback actuators, 
and to robotized remote ultrasound scanning, which can be 
used in the field of obstetrics and for abdominal 
examinations . 

5 In the case of ultrasound scanning, the skin of the 

patient is generally coated with a gel to ensure correct 
transmission of the ultrasound. The ultrasound probe can 
be manipulated at a distance by an operator. Because of 
the presence of the gel, the components of force exerted 
10 by the patient on the probe can be considered as normal 
to the local surface of the skin. The probe has six 
degrees of freedom with force feedback with respect to 
three axes of a three-dimensional system of axes and 
O torque feedback, also with respect to the three axes of a 

,p 15 three-dimensional system of axes. The system can also 

■'lib? 

-J3 apply to remote combat games, fencing games or industrial 

\z applications of the telemachining type. 

ffl The present invention will be better understood and 

m other advantages will become apparent on reading the 

1^ 20 following detailed description of a few embodiments, 
H 5 which description is given by way of non- limiting example 

>I only and illustrated by the accompanying drawings. 

O BRIEF DESCRIPTION OF THE DRAWINGS 

p;s Figure 1 is a diagrammatic view of a first 

25 embodiment of a system according to the invention. 
Figure 2 shows a detail from figure 1. 
Figure 3 shows evolution curves for some parameters 
of the system. 

Figure 4 is a diagrammatic view of a second 
30 embodiment of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

As can be seen in figure 1, a game system in which 
players Jl and J2 compare their strength remotely - this 
kind of game is often referred to as an "iron arm" game - 
35 includes a handgrip Pi for the player Jl and a handgrip 
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P2 for the player J2 . Each handgrip Pi, P2 is connected 
to an interface II, 12 including means for exerting a 
force on the handgrip Pi, P2, for example an electric 
actuator, and means for measuring the force exerted by 
the player Jl, J2 on the handgrip Pi, P2, for example a 
torque sensor or a strain gauge. The interface II, 12 
also includes an acquisition card connected to the means 
for exercising a force and to the measuring means and 
able to exchange digital data with another digital system 
such as a computer. 

Each interface II, 12 is connected to a control 
system SI, S2 . In the case shown here, the systems SI and 
S2 are identical. Only the system SI is described. 
However, embodiments in which one of the two systems is 
of simplified structure compared to the other one can be 
envisaged. 

Generally speaking, the system SI can take the form 
of a personal computer, generally provided with at least 
one microprocessor, random access memory and read-only 
memory, a communication bus, input and output ports and 
one or more programs stored in memory and executed by the 
microprocessor . 

The system SI is connected on the one hand to the 
interface II, for example by an RS 232 bus, and to the 
system S2 by a communication network 3 , which can be a 
synchronous network (for example an ISDN) or an 
asynchronous network ( for example an ATM or UMTS network 
or a TCP/IP network like the Internet) . The system SI is 
located near the player Jl, for example in the same room. 
The system S2 is at a distance from the system SI from a 
few meters to a few thousand kilometers. In other words, 
the system SI , the interface II , the handgrip Pi and the 
player Jl can be described as "local" and the system S2 , 
the interface 12 , the handgrip P2 and the player J2 can 
be described as "remote" . 
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To be more precise, the system Si includes a local 
model ML1 able to send the interface II a set point F e and 
to receive from said interface II a variable measured by 
the interface II, for example the position X of the 
handgrip PI. The set point can be a force or torque 
variable. The system SI includes a remote model MD2 
adapted to estimate a state of the local model ML 2 of the 
system S2 . The remote model MD2 of the system SI can 
receive data from the system S2 and from the local model 
MLl and can send data to the local model ML1. To be more 
precise, the system SI includes an extrapolator EXT 2 
receiving data from the system S2 via the communication 
network 3 in order to process a resynchronization message 
from the system S2 and transmit update data to the remote 
model MD2 as a function of the resynchronization message 
received last. 

The system SI includes a screen El connected to the 
local model MLl to display data from the local model MLl, 
for example a curve tracing the evolution of the forces 
exerted on and the positions of the handgrips PI and P2 . 

The system SI includes a resynchronizer Rl 
receiving data from the local model MLl and adapted to 
send output data to the system S2, in particular to the 
extrapolator EXTl of the system S2 . The resynchronizer Rl 
can handle data preparation for sending the data in the 
form of a resynchronization message that can include a 
time/date, the position X of the handgrip Pi, the force F 
exerted on the handgrip Pi at said time/date and the 
force exerted on the handgrip Pi at an earlier time/date. 

The system SI further includes a phantom model MFl 
which also receives the resynchronization messages from 
the resynchronizer Rl of the system SI and estimates 
state variables of the interface II from the 
resynchronization messages set by the resynchronizer Rl 
and received by the system S2 . In other words, the 
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phantom model MFl produces an estimate based on the same 
data as that received by the remote model MDl of the 
system S2 . Thus the phantom model MFl is used to model 
the variables of the interface II as modeled by the 
5 system S2 . 

The output of the phantom model MFl is connected to 
the resynchronizer Rl which compares the estimate of the 
state variables from the phantom model MFl and the state 
variables from the local model ML1. If the difference 

10 exceeds a predetermined threshold, the resynchronizer Rl 
sends a resynchronization message to the phantom model 
MFl and to the extrapolator EXT1 of the system S2 . Thus 
the volume of data exchanged between the systems SI and 
S2 is relatively small because a resynchronization 

15 message is sent only if one of the two systems Si, S2 
estimates that the other system S2 , Si is no longer able 
to estimate the variables correctly. 

How the system works is clear from figure 2. For 
the player Jl, the state vector X breaks down into three 

20 parts: a variable part X e at the interface with the 
handgrip PI, a variable part X m internal to the mechanical 
model of the player Jl, and an interaction variable X 1 at 
the interface with the other player. Similarly, the 
associated force or torque variable F breaks down into: a 

25 force F e exerted by the player Jl on the handgrip Pi, a 
force F m exerted by gravity, other objects, or any other 
players, and the force F x exerted by the player Jl on the 
player J2 . In a similar manner, the state vector Y of the 
player J2 breaks down into parts Y ,e , Y ,m and Y' 1 and the 

30 associated torque force vector G breaks down into parts 
G ,e , G tm and G ri . The two players Jl and J2 are in virtual 
contact. Thus X 1 = Y 1 . The law of action and reaction then 
yields: F 1 + G ' 1 = 0 . 

On each time increment, the interface II captures 

35 the position X e n and transmits it to the local model MLl . 
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The interface II receives the set point force F e n from the 
local model MLl and uses the force feedback force -F e n to 
control its actuator(s). Similarly, the interface 12 
captures the position Y' e n and transmits it to the local 
model ML 2 and receives the force G ,e n from the local model 
ML 2 and controls its actuator (s) with the force feedback 
force -G e n . 

At the beginning of the time period n+l the local 
model MLl receives the position X e n+1 from the interface 
II, the interaction estimate from tlie remote model 

MD2 and the prestored intrinsic variables F m n+1 . The local 

model MLl calculates the force exerted by the player Jl 

on the player J2 : 

"FP 1 — G 1 
c n+1 n+l 

and the force exerted by the player Jl on the handgrip 
PI: 

F e n+1 = B- 1 {X^.-X^-A^-B-F^B^^! }, 

the matrices A and B being those for the evolution of the 
player Jl with X = AX + BF . The local model MLl then 
calculates : 

r n+l 

The local model MLl sends X n+1 and F n + 1 to the 
resynchronizer Rl, the set point -F e n+1 to the interface II 
and the position variable X i n+1 to the remote model MD2 . 

In the event that it does not receive a message 
from the resynchronizer Rl , the phantom model MFl 
calculates ^ n+1 = ^ n + K 17 K x being provided^by the system 
S2, and the position estimate x n+1 = (I+A) x n + B F n+1/ in 
other words the mechanical state of the player Jl such as 
it can be predicted by the system S2 . Here I is the 
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identity matrix. 

When the phantom model MF1 receives a 
resynchronization message M n = {n, 5T n , F~ n and F" n _ x } from 
the resynchronizer Rl, it carries out the following 
resynchronization: ^ n = X" n/ F n = F" n and Kl = F" n - ^Vi- 

In each time increment n the resynchronizer Rl 
receives the position variable X n and the force variable 
F n and F n+1 from the local model ML1 and the estimate & n 
from the phantom model MF1. It compares the absolute 
value of the difference between the position variable X n 
and the estimate ^ n to a predetermined threshold and does 
nothing if said absolute value is below said threshold. 
If said absolute value is not below said threshold, it 
composes a resynchronization message M n = {n, X n/ F n/ F^} . 
The resynchronizer Rl sends the resynchronization message 
M n to the phantom model MFl so that it resynchronizes 
itself immediately and to the remote model MD1 via the 
extrapolator EXTl of" the system 32 so that it 
resynchronizes itself as soon as possible. 

The extrapolator EXT 2 of the system Si is used for 
synchronization. The message Mp = {p, Y p/ G p , Gp.J sent by 
the resynchronizer R2 of the system S2 reaches the system 
SI at a time from n to n + 1 . However, the message Mp is 
stamped with the time/date p from the system S2 . The 
extrapolator EXT2 calculates K 2 = G p - G p _ x and 
resynchronizes the remote model MD2 as follows: ^ p = G p 
and ^" p = Y p/ and then at the subsequent times, and 
regardless of the outcome: j = p,...,n, j+1 = j + K2 
and = + C^V + D 6 ^, C and D being the matrices 

equivalent to the matrices A and B for the player J2 . The 
extrapolator EXT2 sends the remote model MD2 the 
resynchronization result ^^^^ and K 2 . 

The remote model MD2 of the system SI 
resynchronizes itself on receiving a message from the 
extrapolator EXT 2 , taking the values supplied by said 
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extrapolator EXT2 : 

&n + l = G n+V Z + \ = K+l and ^2 = ^2 

When not receiving any such message, and on each 
time increment, the remote model MD2 receives the 
position variable X i n+1 from the local model MLl and 
performs a predictive calculation: 

Gr /i+t = Cr nil L 

The remote model MD2 sends the local model MLl the 
position variable prediction G n+1 relating to the player 
J2. 

The extrapolator EXT 2 preferably effects a bevel 
resynchronization which smoothes the changes. One example 
of such resynchronization is shown in the figure 3 
curves. Instead of changing the estimate of the position 
variable Y suddenly to the variable ^ as calculated by 
the extrapolator EXT 2 in the manner explained above, the 
resynchronization is effected in four steps between times 
n and n + 4, as follows: 

k = | ? n+1 - ^ n+1 | / threshold + 1. 

If k - 1, then ? n+1 := ^ n+1 . 
If not, j = n, 


15 


G j+l =Gj + K2 
j:= j+1 

If k is greater than 2, then k: = k - 1 

Otherwise the loop is left and Y j+l = The bevel 

resynchronization enables the system to operate more 
smoothly, which is better appreciated by users and 
entails fewer mechanical constraints. 

More generally, the phantom model MFl receives the 
same data as the remote model MDl of the other system and 
can effect the same simulation as said other system. In 
other words, a search is conducted to find out what the 
other system does not know for the purposes of 
resynchronization. The resynchronizer works blind 
relative to the other system and enables simulation to 
continue in the absence of pertinent data transmitted by 
a resynchronization message from the other system. 
Especially in the case of bevel resynchronization, the 
extrapolator EXT 2 takes account of movement as measured 
by the other system during the transmission time-delay 
caused by the communication network. In a simplified 
variant, it is perfectly conceivable for either or both 
systems to have no phantom model. A number of systems 
greater than two can equally be made to work together. 

The local models represent the mechanical models of 
the two users. The remote models represent a remote 
replication of the local mechanical models which is 
necessarily approximate because of the time-delays on 
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transmitting the states of the local models via the 
communication network. The phantom models represent an 
approximate local copy of the remote model. The remote 
models and the phantom models both work in predictor- 
corrector mode. The extrapolators extrapolate messages 
received with a certain time-delay to resynchronize the 
remote models to the clock value of the other system. The 
resynchronizers evaluate the necessity to launch a 
resynchronization message into the communication network 
as soon as there is too great a difference between the 
local models and the local witness predictive phantom 
models of the remote predictive models. The 
resynchronizers limit the number of messages sent via the 
communication network to avoid congestion on the network. 
Within a system, information can be exchanged at the rate 
of 1 kHz. Between the systems, and therefore via the 
communication network, messages are exchanged if one of 
the resynchronizers considers 'it to be necessary. 

Figure 4 shows an embodiment of the invention 
intended for ultrasound scanning. A control system SI is 
installed in an establishment that does not specialize in 
obstetrics, for example in an establishment of a small 
town or in a vehicle serving rural areas . The system S2 
is installed in a specialized hospital establishment in 
which highly qualified operators are available to perform 
the ultrasound scanning operations, for example a 
regional or teaching hospital. A patient J3 lies on a bed 
or a table T. An ultrasound scanning probe SE is in 
contact with their abdomen. A panel TR for adjusting 
parameters of the probe SE is installed nearby. The probe 
SE is connected to the system SI and transmits ultrasound 
scanning image data to said system SI; it also exchanges 
data relating to the position of and to the actions 
exerted by the system SI. To clarify the drawing, the 
support of the probe SE is not shown; it can be an 
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articulated arm. Nevertheless, it is to be understood 
that this support provides movement in space with several 
degrees of freedom, in general at least six degrees of 
freedom, so that a suitable position in contact with the 
abdomen of the patient J3 can be adopted. A microphone 
MI3 and a loudspeaker HP 3 are connected to the system SI 
to enable the patient to converse with the remote 
operator. A video camera CA3 points toward the patient J3 
and a video screen EV3 enables the patient to see either 
the remote operator or the ultrasound scanning images. 
The video camera CA3 and the video screen EV3 are also 
connected to the system SI. In addition to the items 
described with reference to figures 1 and 2, the systems 
SI and S2 each include a multiplexer-demultiplexer DM1 
and DM2 for transmitting data via the network 3, which 
can be an ADSL network, for example. 

The operator J 4 of the system S2 , who can be a 
doctor specializing in ultrasound scanning, manipulates a 
handgrip P3 whose position in space is replicated by the 
probe SE. The handgrip P3 is connected to an articulated 
arm BA which is in turn connected to an interface 13 
which is of the same kind as the interfaces II and 12 
described above and includes one or more actuators and 
one or more position sensors and force sensors. The 
effect can be measured by measuring an actuator energy 
parameter, for example the current drawn, or by means of 
a strain gauge. The interface 13 is connected to the 
system S2 . 

A video camera CA4 points toward the operator J 4 
and the pictures it generates can be displayed on the 
screen EV3 . A microphone MI4 and a loudspeaker HP4 enable 
the operator J4 to converse with the patient J3 . These 
items are connected to the system S2 . A large video 
screen EV4 displays a plurality of images simultaneously, 
for example an ultrasound scanning image, an image of the 
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face of the patient J3 and an image showing the position 
of the probe SE on the abdomen of the patient. 
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